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[57] ABSTRACT 

In a picture processing apparatus such as a camera, monitor 
camera, television and the like, an imaging device is con- 
trolled to follow a desired target object and image it in the 
best state. A distribution of motion vectors within a tracking 
vector detection area is detected, and then the most charac- 
teristic motion vector is detected. In a second embodiment 
a power of components in a high frequency band is detected 
per unit of predetennined blocks, difference data between 
picture data of motion pictures of the present frame and the 
previous frame is obtained, the power of the difference data 
is detected per unit of predetermined blocks, and an edge 
having movement is detected on the basis of the detection 
result. 

11 Claims, 11 Drawing Sheets 




07/13/2004, EAST Version: 1.4.1 



5,552,823 

Page 2 



FOREIGN PATENT DOCUMENTS 

0400998 12/1990 European PaL Off. H04N 5/14 

0424060A2 4/1991 European PaL Off. H04N 7/30 

0458373A2 11/1991 European PaL Off. H04N 5/232 



0458373 11/1991 European Pat. Off. . H04N 5/232 

0520741A1 12/1992 European Pal. Off, H04N 5/232 

0541302A2 5/1993 European PaL Off. H04N 7/24 

2096681 6/1990 Japan .. _ G01S 3/786 

2242590 10/1991 United Kingdom G01S 3/78 



07/13/2004, EAST version: 1.4.1 



U.S. Patent Sep. 3, 1996 sheet i of ii 5,552,823 



1 0 1 



SD 



103 



102 Imoging 






Y Device 






O 


i 


i 





^ Pictu re Conversion Apparatus 

' ►D0,SP1,SP2,SEL 



•sv 



104 



( Traget Object ¥ T 
) | Trockina Apparatus . ) ' 



Picture 

■(x1,y1),(x2.y2).ST Djsp , oy 



105 



Input Circuit 



FIG. 1 



07/13/2004, EAST version: 1.4.1 



U.S. Patent 



Sep. 3, 1996 



Sheet 2 of 11 



5,552,823 




07/13/2004, EAST Version: 1.4.1 



U.S. Patent 



Sep. 3, 1996 Sheet 3 of 11 



5,552,823 




FIG. 3 



VTQBl IK) 

/ 




FIG. 4 



07/13/2004, EAST Version: 1.4.1 



U.S. Patent Sep. 3, 1996 Sheet 4 of 11 



5,552,823 



Distribution 



Motion Detection Circuit MV^i r j c e u f t in9 



Judging Circuit 

t 




(xl yD (x2 y» 



FIG. 5 




Blocking Circuit 



501 



Matching Circuit 



FIG. 6 



603 

Frame Memory 



07/13/2004, EAST Version: 1.4.1 



U.S. Patent Sep. 3, 1996 sheet 5 of 11 5,552,823 




FIG. 7 




FIG. 8 



07/13/2004, EAST Version: 1.4.1 



U.S. Patent Sep. 3, 1996 sheet 6 of 11 5,552,823 




07/13/2004, EAST Version: 1.4.1 



U.S. Patent Sep. 3, 1996 sheet 7 of 11 5,552,823 




07/13/2004, EAST version: 1.4.1 



U.S. Patent Sep. 3, 1996 Sheet 8 of 11 

8 



5,552 




FIG. 11 




FIG. 12 



07/13/2004, EAST version: 1.4.1 



U.S. Patent 



Sep. 3, 1996 Sheet 9 of 11 

flu j ,m j 



5,552,823 



BLi-L j-1- 
BLH j ' 

BLi-L j+1" 



4- 



■ — BLi+L j-1 
— BLi+L j 



>BLi+l j+1 



BLi. j+1 

FIG. 13 



/ 


/ 


/ 










,^-BLi. j 


/ 


/ 


/ 




FIG. 


14 




\ 


\ 


/ 










— BLi, j 




/ 




-MVi. j 



FIG. 15 



07/13/2004, EAST Version: 1.4.1 



U.S. Patent Sep. 3, 1996 



Sheet 10 of 11 



5,552,823 




FIG. 16 



07/13/2004, EAST version: 1.4.1 



U.S. Patent Sep. 3, 1996 sheet 11 of 11 5,552,823 




07/13/2004, EAST Version: 1.4.1 



5,552,823 



PICTURE PROCESSING APPARATUS WITH 
OBJECT TRACKING 

This is a continuation of application Ser. No. 08/018,155 
filed Feb. 16, 1993 now abandoned. 5 



FIELD OF THE INVENTION 

This invention relates to a picture processing apparatus, 
and is applicable to an imaging device, for example, a 
television camera, a monitor camera, and a television con- 
ference system, besides a picture data transmitting system, 
which carries out compensation for the motion of picture 
data, and the like. 



BACKGROUND OF THE INVENTION 

Conventionally, as an apparatus for following an object to 
be imaged, a picture processing apparatus was proposed for 20 
following a targeted portion of a picture, by detecting the 
brightest region in an image picked up, on the basis of which 
the desired target portion is followed. 

If any desired portion of an image can be tracked in such 
a way, then automatic focusing, iris adjustment and the like 25 
can be performed for this portion of the image to be able to 
achieve the improvement of the easy use of imaging devices. 

However, there is a problem that the apparatus in which 
a desired portion of an image is tracked based on the 
brightest region in the image, can not follow a target portion 
of the image reliably, thereby being insufficient to use 
practically. 

One method for solving this problem is to follow the 
target portion of an image on the basis of a picture charac- 35 
teristic thereof. However, this method has a disadvantage 
that a generally complicated structure is required for the 
apparatus. 

A further method for solving this problem is to detect 
motion of a target portion of an image, by detecting a power 40 
of difference data obtained from a difference between 
frames, but in some cases, a detected result which is different 
from the motion of the target portion of an image may be 
obtained. 

Another proposed method is to detect motion of a target 45 
portion of a picture, by using a time spatial filter apparatus. 
However, in this method, an amount of operation is large, 
therefore, this method has a disadvantage that a generally 
complicated structure is required for the apparatus. 

On the other hand, conventionally, a method for trans- 50 
mining a motion picture with high efficiency is proposed. 

More specifically, in such a picture conversion apparatus, 
picture data sequentially inputted are divided into predeter- 
mined unit blocks, and then a motion vector is detected for 
every block, by using the block matching method 

Then, residual data is generated by subtracting picture 
data sequentially motion compensated for each block of 
picture data, after motion compensating picture data which 



30 



55 



60 



is for one frame, on the basis of said detected result 

Thus, the amount of picture data is previously reduced, as 
compared to a case in which picture data is directly trans- 
mitted by using correlation between frames of motion pic- 
ture. 

This residual data is sequentially processed with discrete 65 
cosine transform and variable length coding, and is stored 
into a buffer memory after re-quantizing said residual <i?ta 



Thus, the picture data stored in the buffer memory are 
sequentially outputted from it at predetermined timing; and 
picture data is outputted keeping the amount of data at a 
constant value by changing a quantization step size of the 
re-quantizer, corresponding to a residual quantity of said 
buffer memory. 

Thus, the motion picture can be transmitted with high 
efficiency, by using correlation of between frames of a 
motion picture. 

Now, in the motion picture, a part of large motion has a 
characteristic that deterioration of picture quality is imper- 
ceptible. 

Further, in such a motion picture, having a case where part 
of a picture has pronounced changes as compared with 
changes of thus around picture, another case of changes to 
the whole of a picture occurs. 

In this case of a motion picture, it has a characteristic that 
deterioration of picture quality is more imperceptible, com- 
paring to a case where the whole of a picture has constant 
motion. 

With effectively using this unique characteristic, it is 
expected that more efficient transmission of motion pictures 
can be achieved. It is also expected that the quality of motion 
picture can be improved compared to the conventional 
technology. 

SUMMARY OF THE INVENTION 

In view of the foregoing, an object of this invention is to 
provide a picture processing apparatus, for example, a 
television camera, monitor camera, television conference 
system and the like, which controls an imaging device to 
take a picture into the best condition by tracking a target 
portion of a picture. Further, in the thus obtained picture, a 
high quality motion picture is to be transmitted with high 
efficiency, by making effective use of human visual sensi- 
tivity. 

A target object following apparatus for following a por- 
tion of a picture, comprises: an input circuit for setting a 
tracking vector detection region to a motion picture inputted 
from an imaging device; 
a tracking vector detection circuit for detecting a motion 
direction and motion distance of a picture in the track- 
ing vector detection region, about a picture in the 
tracking vector detection region which is set by said 
input circuit; 

a window-frame data generation circuit for designating an 
area followed by said tracking vector detection circuit 
by use of a window frame, and for generating a control 
signal which is always caught on a target portion of a 
picture; 

a picture composing circuit for composing a motion 
picture inputted from said imaging device with said 
window frame; and 

a camera driving circuit for driving said imaging device, 
by controlling a signal generated from said window- 
frame data generation circuit: wherein 
the output of the picture composing circuit is displayed 
on. a picture displaying device to be able to observe 
a state of following the target object, and to control 
the imaging device to be able to catch the target 
object always in the best state. 
The tracking vector detection circuit can track the target 
portion of a picture, by detecting a distribution of motion 
vectors in said tracking vector detection region, and can 
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track a target portion of a picture by using spatial edges and 
time edges. 

On the other hand, a picture conversion apparatus for 
performing transmission of said high quality motion picture, 
comprises: 5 
a motion detection circuit for detecting a motion vector 
for each block, after dividing picture data inputted from 
an imaging device into a predetermined number of unit 
blocks; 

a picture data processing apparatus for outputting a 10 
residual data after motion compensating picture data on 
the basis of a motion vector, 
a motion field detection circuit for detecting disorder of a 
motion vector about a block of residual data and 15 
adjacent blocks in surrounding regions; 
a re-quantization circuit for outputting quantization data 

for quantizing the residual data; and 
a buffer circuit for storing quantization data and output- 
ting thereof; wherein 20 
when the motion vector is in disorder, the requantiza- 
tion circuit quantizes the residual data, after chang- 
ing the quantization step size in a large way, on the 
basis of the detection result from the motion field 
detection circuit. 25 
With the above construction of the present invention, is 
possible to detect a movement direction and movement 
distance of a target portion of a picture with simple con- 
struction, and this can be achieved by making effective use 
of human visual sensitivity so as to transmit the picture 30 
signal with high picture quality. 

The nature, principle and utility of the invention will 
become more apparent from the following detailed descrip- 
tion when read in conjunction with the accompanying draw- 
ings in which like parts are designated by like reference 35 
numerals or characters. 



BRIEF DESCRIPTION OF THE DRAWINGS 



40 



In the accompanying drawings: 

FIG. 1 is a block diagram showing a picture processing 
apparatus according to the present invention; 

FIG. 2 is a block diagram showing first and second 
embodiments of a target object following apparatus; 45 

FIG. 3 is a schematic diagram illustrating a description of 
setting of a tracking vector detection region, in the first and 
second embodiments of the target object tracking apparatus; 

FIG. 4 is a schematic diagram illustrating a description of 
a frame display position, in the first and second embodi- 50 
ments of the target object tracking apparatus; 

FIG. 5 is a block diagram showing a tracking vector 
detection circuit, in the first and second embodiments of the 
target object tracking apparatus; 

FIG. 6 is a block diagram showing a motion detection 55 
circuit, in the first embodiment of the target object tracking 
apparatus; 

FIG. 7 is a schematic diagram illustrating a description of 
a blocking circuit, in the first and second embodiments of the ^ 
target object tracking apparatus; 

FIG. 8 is a schematic diagram illustrating a description of 
detecting of a motion vector, in the first embodiment of the 
target object tracking apparatus; 

FIG. 9 is a block diagram showing a tracking vector 65 
detection circuit, in the second embodiment of the target 
object tracking apparatus; 



FIG. 10 is a block diagram showing an embodiment of a 
picture conversion apparatus; 

FIG. 11 is a schematic diagram illustrating a block of 
picture data, in the embodiment of the picture conversion 
apparatus; 

FIG. 12 is a schematic diagram illustrating a motion 
vector detection region, in the embodiment of the picture 
conversion apparatus; 

FIG. 13 is a schematic diagram illustrating description of 
motion field detection, in the embodiment of the picture 
conversion apparatus; 

FIG. 14 is a schematic diagram illustrating a case when 
motion vectors are of small disorder, 

FIG. 15 is a schematic diagram illustrating a case when 
motion vectors are of large disorder, 

HG. 16 is a schematic diagram illustrating description of 
switching a quantization step size, in the embodiment of 
picture conversion apparatus; and 

FIG. 17 is a block diagram showing a demodulation 
circuit, in the embodiment of the picture conversion appa- 
ratus. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Preferred embodiments of this invention will be described 
with reference to the accompanying drawings: 

(1) General Construction of The Picture Processing 
Apparatus In The Present Invention 

In FIG. 1, 101 designates a general construction of a 
picture processing apparatus in the present invention. 

Video signal SV imaged by an imaging device 102 is 
transmitted to a picture conversion apparatus 103 and to a 
target object tracking apparatus 104. 

An input circuit 105 sets a position of a target portion of 
a picture by use of a frame, and outputs coordinate data 
showing this tracking vector detection region (xl, yl) (x2, 
y2) and a trigger signal ST which commands tracking 
execution. 

In the target object tracking apparatus 104, a target portion 
of a picture selected by the input circuit 105 is tracked, as 
thus the tracking state, a picture having a shape of a window 
frame which catches the target portion of a picture is 
composed with video signal SV, then the composite picture 
M is displayed on a picture display 106. 

In this way, the video signal SV imaged into the best 
condition by imaging device 102, is displays to effectively 
process the picture signal by use of human visual charac- 
teristic in a picture conversion apparatus 103, thereby output 
picture signals DO, SP1, SP2 and SEL are transmitted. 

(2) First Embodiment of the Object Tracking Apparatus 
(2-1) General Construction 

In FIG. 2, 201 designates the target object tracking device 
for tracking a picture of a subject specified by a user to adjust 
an iris and focus. 

That is, an imaging device- 102 images a picture of a 
desired target object in a field of vision and then outputs a 
resultant video signal SV of the picture to a tracking vector 
detection circuit 202. 

The tracking vector detection circuit 202 converts suc- 
cessively input video signals S V into digital signals and sets 
a tracking vector detection region AR, based on coordinate 
data (xl, yl) and (x2, Y2) input from an input circuit 105. 

Furthermore, when a trigger signal ST is input from the 
input circuit 105, the tracking vector detection circuit 202 
detects a tracking vector VT which represents a motion 
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direction and motion distance of the target object of a 
portion of a picture existing in the tracking vector detection 
region AR, and furthermore outputs the detection result to a 
window-frame data generator 205. 

When the tracking vector VT is obtained, the tracking 5 
vector detection circuit 202 shifts the tracking vector detec- 
tion region AR by the amount corresponding to the tracking 
vector VT. Then, the tracking vector detection circuit 202 
repeats the detection of the tracking vector VT for the 
subsequent frame using the tracking vector detection region 
AR which has been shifted. 

In this way, tracking-vector detection circuit 202 detects 
a motion direction and motion distance of a picture in the 
tracking vector detection region AR and also shifts the 
tracking vector detection region AR to follow the motion of 
the picture. 15 

In the target object tracking device 201, the input circuit 
105 is operated for inputting coordinate data with a joystick 
so that the tracking-vector detection region AR is set by 
operation with the joystick. 

In the target object tracking device 201, the video signal 20 
SV is applied to a picture composing circuit 204, whereas a 
picture having a shape of a window frame (hereafter referred 
to as a window-frame picture) WK is generated based on a 
window-frame data DW given from the window-frame data 
generator 205 as shown in FIG. 3. 25 

Moreover, in the target object tracking device 201, the 
window-frame picture WK is superimposed on the video 
signal SV by the picture composing circuit 204, then the 
resultant composite picture M is displayed on a picture 
display 106. 30 

In the above process, based on the coordinate data (xl, yl) 
and (x2, y2) input from the input circuit 105, the window- 
frame data generator 205 generates window-frame data DW 
corresponding to the tracking- vector detection region AR so 
that the window-frame picture WK represents the tracking- 35 
vector detection region AR. 

In this way, in the target object tracking device 201, a 
tracking-vector detection region AR can be set easily only 
by operating a joystick while monitoring a picture display 
106. 40 

In this preferred embodiment, a window-frame picture 
WK of predetermined size is displayed at the central posi- 
tion of the screen in the initial state. Then, a user can change 
the position and size of the window-frame picture WK by 
operating the joystick and monitoring the displayed picture 45 
to set the desired tracking-vector detection region AR. 

In this setting operation, the tracking-vector detection 
region AR is set to a size including an certain integer number 
of unit blocks for detecting a motion vector so that a tracking 
vector can be detected easily based on the detection result of 50 
the motion vector. 

Moreover when a starting button for starting the tracking 
operation is pressed, the input circuit 105 outputs a trigger 
signal ST for starting the tracking operation, whereas when 
an ending button for ending the tracking operation is 55 
pressed, the input circuit 105 outputs a control signal for 
ending the tracking operation. In this way, operation is 
controlled overall for the target object tracking device 201. 

As shown in FIG. 4, when a tracking vector VT (DX, DY) 
is obtained, the window-frame data generator 205 adds 60 
two-dimensional coordinate components DX, DY to the 
coordinates (xl, yl) and (x2, y2) of the window-frame data 
DW and outputs the result 

Thus, based on the tracking vector VT, the window-frame 
data generator 205 updates the window-frame data DW so 65 
that the window-frame picture WK is moved to follow the 
motion of a picture in the tracking-vector detection region. 



Furthermore, in this embodiment, the window-frame data 
generator 205 outputs the window-frame data DW to a 
control circuit (207), then this control circuit 207 detects a 
signal level of the video signal SV in the region which is 
defined by the window-frame data DW (that is, the tracking- 
vector detection region AR). Based on the detection result, 
the control circuit 207 controls the focus and the iris of the 
imaging device 102. 

In this way, in the target object tracking device 201, the 
motion of the targeted picture in the tracking-vector detec- 
tion region AR which is set by a user is tracked so that the 
optimum brightness and focus are always maintained for the 
targeted picture. 

(2-2) Tracking- Vector Detection Circuit 

As shown in FIG. 5, the tracking-vector detection circuit 
202 gives the video signal S V to the motion detection circuit 
501, by which the motion vector MV is detected 

Then, as shown in FIG. 6, the motion vector detection 
circuit 501 gives the video signal S V to the blocking circuit 
601. The motion vector detection circuit 501 converts this 
video signal S V into a digital signal (hereafter, referred to as 
a digital video signal). 

Furthermore, as shown in FIG. 7, the blocking circuit 601 
divides the digital video signal into blocks BL each of which 
contains 8x8 pixels, then outputs the digital video signal for 
every block according to the order of raster scanning (FIG. 
7 shows a block located at (m, k) pixel position). 

A matching circuit 602 obtains the motion vector MV for 
every block by adapting the block matching method to the 
result of comparison between the output signal from the 
blocking circuit 601 and the output signal from a frame 
memory 603. 

That is, as shown in FIG. 8, the matching circuit 602 
assigns a region which is wider than a block by 2Dxx2Dy in 
horizontal and vertical directions respectively for a motion- 
vector detection region ARM for every block. Then, the 
matching circuit 602 detects the difference between the 
present picture data in a block and the one-frame-previous 
data in the motion-vector detection region ARM, wherein 
the one-frame-previous data is stored in the frame memory 
603. 

During the above process, the matching circuit 602 
changes successively the location of the block BL within the 
motion-vector detection region ARM, and determines the 
location where the sum of the absolute values of the above 
differences is minimized. 

In this way, the matching circuit 602 detects the motion 
vector MV for every block BL, and then outputs the detected 
result to a distribution detecting circuit 502. 

The distribution detecting circuit 502 detects the distri- 
bution of the motion vector MV in the tracking-vector 
detection region AR with respect to direction and magni- 
tude. The detected result is output to a judging circuit 503. 

More specifically, the distribution detecting circuit 502 
has a table having a size of 2DXx2DY corresponding to the 
motion vector detection region ARM. The contents of the 
table are initialized and set to 0 at the beginning of every 
frame. The distribution detecting circuit 502 updates the 
contents of the table one at a time depending on the value of 
the motion vector MV. Thus, the distribution of the motion 
vector MV is detected based on the motion- vector detection 
region ARM. 

Furthermore, the distribution detecting circuit 502 
updates the tracking-vector detection region AR, based on 
the detection result with respect to the tracking vector given 
by the judging circuit 503. Thus, while the distribution 
detecting circuit 502 updates the tracking-vector detection 
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region AR for every frame to track the motion of the picture, 
it detects the distribution of the motion vector in the updated 
tracking-vector detection region AR. 

Based on the result of the detected distribution, the 
judging circuit 503 sets a motion vector MV having the 5 
biggest count in the distribution as the tracking vector VT, 
then outputs this tracking vector. 

A motion vector MV showing the most dominant motion 
among the motion vectors within a frame which is set to 
surround the target object can be considered to represent the 10 
direction and magnitude of the motion of the target object. 

Therefore, by detecting the most dominant motion vector, 
the desired target object can be tracked with a simple 
construction of apparatus. This tracking capability can be 
effectively used for automatic focusing and automatic IS 
adjustment of an iris. Thus, easier operation is achieved for 
the target object tracking apparatus 201. 

(2-3) Operation of an Embodiment 

In the above construction, the output video signal SV 
from the imaging device 102 is applied to the tracking- 20 
vector detection circuit 202. Then, after converting the video 
signal into the digital signal, the blocking circuit 601 divides 
the digital video signal into blocks consisting of 8x8 pixels. 

For each of these blocks, the motion vector MV is 
detected by the matching circuit 602. 25 

This motion vector MV is applied to the distribution 
detecting circuit 502, by which the distribution of the motion 
vector MV in the tracking-vector detection region AR is 
detected and a motion vector MV showing the most domi- 
nant motion is set as the tracking vector VT. 30 

As described above, the distribution of the motion vector 
is obtained and the most dominant motion vector MV is set 
as the tracking vector VT, thus the motion of the target object 
can be tracked with a simple construction. 

The detection result of the tracking vector is applied to the 35 
window-frame data generator 205, by which the window- 
frame data DW is updated based on the tracking vector VT 
so that the window-frame picture WK is moved on the 
screen of the display 106 following the motion of the 
picture. 40 

Moreover, by detecting the signal level of the video signal 
SV in the region defined by the window-frame data DW, it 
is possible to control the focus and the iris of the imaging 
device 102, following the motion of the target object. 

Furthermore, the detection result of the tracking vector is 45 
applied to the distribution detecting circuit 502, by which the 
tracking vector is detected for the subsequent frame. In this 
way, the tracking vector can be detected for successive 
frames. 

(2-4) Other Embodiments 50 

In the above embodiment, the focusing and the iris are 
adjusted based on the detection result of the tracking vector. 
However, the present invention is not limited to that A 
zooming operation or the like can be also performed in 
addition to that 55 

Furthermore, instead of moving the window frame, a 
similar operation can be achieved by outputting the control 
signal SC to the camera driving circuit 206 (FIG. 2) to 
change the picture sensing region following the motion of 
the target object. In this case, a combination of the motion 60 
of the window frame and a change of the picture sensing 
region is also possible to adapt to the motion velocity. 

In the above embodiment, the contents of the table are 
updated directJy from the detection result of the motion 
vector to detect the tracking vector. However, the present 65 
invention is not limited to that. After re-quantization of the 
motion vector, a similar operation can be also achieved. 
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In this case, when the accuracy of the tracking vector is 
not good enough, the size of the table can be reduced Thus, 
it becomes possible to detect the motion of the target object 
with a simpler construction. 

Furthermore, in the above embodiment, after detecting the 
motion vector MV for every block BL, the distribution of the 
motion vector MV in the tracking-vector detection region 
AR is detected. However, the present invention is not limited 
to that Similar effect can be also achieved for the case where 
the distribution is detected after the motion vector MV is 
detected only within one block in the tracking vector detec- 
tion region. 

(3) Second Embodiment of The Target Object Tracking 
Device 
(3-1) General Construction 

A second embodiment of the targeted-object tracking 
apparatus, as described above in FIG. 2, has an entire 
construction the same as the first embodiment of said target 
object tracking apparatus. 

(3-2) Tracking- Vector Detection Circuit 

The tracking-vector detection circuit 202 detects motion 
edges from the video signal SV, then based on this detection 
result detects the tracking vector VT. 

That is, as shown in FIG. 9, in the tracking-vector 
detection circuit 202, the successively input video signal SV 
is converted into a digital signal to generate picture data, and 
then this picture data is applied to a blocking circuit 901. 

The blocking circuit 901 successively outputs the above 
picture data, according to the order of raster scanning, 
together with the picture data with regard to eight pixels 
surrounding the present picture data. 

In this way, the blocking circuit 901 divides the succes- 
sively input video signal S V into unit blocks containing 3x3 
pixels, then successively outputs the video signal block by 
block. 

A deviation detecting circuit 902 determines the average 
value with respect to the output data from the blocking 
circuit 901, then generates the deviation data by subtracting 
each output data from the above obtained average value. 

Thus, the deviation detecting circuit extracts high fre- 
quency components block by block and outputs the results. 

Furthermore, the deviation detecting circuit 902 deter- 
mines the sum of the absolute values of the deviation data to 
determined the sum of the absolute values of the deviations 
for each block. Thus, the high frequency component power 
is determined block by block. 

A spatial edge detecting circuit 903 compares the power 
detected by the deviation detecting circuit 902 with a 
predetermined threshold stored in a table 904 and sets a 
spatial edge detection flag KF when the high frequency 
component power becomes larger than the threshold 

That is, when there exist edges, a large value of the 
deviation data is obtained for each corresponding block. 

Therefore, as in this specific embodiment, if the high 
frequency component power is detected for each block, then 
it becomes possible to detect the existence of an edge, based 
on the power detection result. 

In this way, in the tracking-vector detection circuit 202, 
the high frequency component power is detected for prede- 
termined blocks to detect edges in the two-dimensional 
space of a motion picture. 

A frame memory 905 stores and outputs one frame of 
digitized video signal SV, Thus, the frame memory 905 can 
output picture data which is one-frame previous to the frame 
of the output data of the blocking circuit 901 (hereafter, the 
data in the frame memory will be referred to as a previous 
frame data and the output data of the blocking circuit 901 
will be referred to as a current frame data). 
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In the above processing, the frame memory 905 succes- 
sively outputs the picture data corresponding to the blocking 
circuit 901, together with the data of eight pixels surround- 
ing the current pixel, according to the order of the raster 
scanning. s 

Thus, the frame memory 905 successively outputs the 
previous frame data, corresponding to the output data of the 
blocking circuit 901, block by block wherein one block 
consists of 3x3 pixels. 

A difference detecting circuit 906 obtains the difference 10 
data by subtracting the output data of the frame memory 905 
from the corresponding output data of the blocking circuit 
901. Thus, the difference detecting circuit 906 successively 
outputs the difference data for each 3x3 pixel block. 

A power detecting circuit 907 detects the power of the 15 
difference data by detecting the sum of the absolute values 
of the difference data, and then outputs the obtained result. 

A time edge detecting circuit 908 compares the power 
detected by the power detecting circuit 907 with a prede- 
termined threshold stored in a table 909 and sets a time edge 20 
detection flag JF when the power of the difference data 
exceeds the threshold. 

That is, when change occurs in a picture, a large value is 
obtained in the difference data between the current frame 
and the previous frame. 25 

Obtaining the difference data between the current frame 
and the previous frame implies extracting of high frequency 
components along the time axis. This means that edge 
components are extracted with respect to the time axis. 

That is, if the power of the difference data is detected for 30 
each small block consisting of 3x3 pixels, then, based on this 
detection result, it is possible to detect edges along the time 
axis, that is, an abrupt change in a picture as in the case 
where an edge moves in the two-dimensional space. 

Based on the edge detection principle described above, an 35 
edge judging circuit 910 sets a motion edge detection flag 
JKF when the spatial edge detection flag KF and the time 
edge detection flag JF are set. Thus, the edge judging circuit 
910 detects a motion edge and outputs the detected result. 

In this way, edges are detected with respect to both time 40 
and space using a small block as a detection unit. Based on 
this detection result, motion edges are detected. Thus, it is 
possible to easily make reliable detection of motion edges. 

As shown in FIG. 7, a motion detecting circuit 911 divides 
a digital video signal into blocks BL wherein each of block 45 
consists of 8x8 pixels (FIG. 7 shows a block located at the 
position (kxm)), and then detects the motion vector a MV for 
each block by using the block matching method. 

That is, the motion detecting circuit 911 detects the 
residual difference in the data between the previous frame 50 
and the current frame for each block, then further determines 
the sum of the absolute values of the above resultant residual 
difference data. 

In this processing, the motion detecting circuit 911 suc- 
cessively shifts the position of each block within a prede- 55 
termined motion vector detection region to detect the posi- 
tion where the above sum of the residual difference data is 
minimized. Thus, the motion vector is detected. 

In the above processing, the motion detection circuit 911 
selectively performs the above motion vector detection 60 
processing only for blocks whose corresponding motion- 
edge detection flag JKF is set in the tracking-vector detec- 
tion region AR. 

The selective detection of the motion vector only for the 
blocks in the tracking-vector detection region AR leads to 65 
reduction in the amount of calculation compared to the case 
where the motion vector is detected for all blocks. 



Furthermore, by detecting the motion vector only for the 
blocks whose corresponding motion-edge detection flag JFK 
is set, it is possible to selectively detect only the motion 
vectors reflecting the motion of the target object. Thus, the 
detection accuracy can be improved. Besides, the amount of 
calculation can be also reduced 

A judging circuit 912 detects the distribution of the 
motion vector, based on the direction and magnitude of the 
motion vector. Then, the judging circuit 912 detects the 
tracking vector VT, based on the detection result of the 
above distribution. 

That is, the judging circuit 912 has a table having a size 
of 2Dxx2Dy corresponding to the motion-vector detection 
region. The contents of this table are initialized and set to 
"0" at the beginning of every frame. The judging circuit 912 
adds unit value, "1", one at a time, to the contents of the table 
depending on the value of the motion vector MV. Thus, the 
distribution of the motion vector is detected with respect to 
the motion-vector detection region. 

Based on the result of the detected distribution, the 
judging circuit 912 sets a motion vector MV having the 
biggest count in the distribution as the tracking vector VT, 
and then outputs this tracking vector, 

A motion vector MV showing the most dominant motion 
among the motion vectors within a window frame which is 
set to surround the target object can be considered to 
represent the direction and magnitude of the motion of the 
target object. 

Therefore, by detecting the most dominant motion vector, 
the desired target picture can be tracked with a simple 
construction of apparatus. This tracking capability can be 
effectively used for automatic focusing and automatic 
adjustment of an iris. Thus, an easier operation is achieved 
for the target object tracking apparatus. 

Furthermore, the judging circuit 912 updates the tracking- 
vector detection region AR, based on the result of the 
tracking vector detection. Thus, while updating the tracking- 
vector detection region AR for every frame to follow the 
motion of the picture, the judging circuit 912 detects the 
distribution of the motion vector in the updated tracking- 
vector detection region AR. 

(3-3) Operation of an Embodiment 

In the above construction, the output video signal SV 
from the imaging device 102 is successively applied to the 
deviation detecting circuit 902 by unit of 3x3 pixels via the 
blocking circuit 901. The deviation detecting circuit 902 
determines the deviation of the given data from the average 
value. 

Furthermore, the sum of the absolute values of the above 
deviation data is determined. Thus, the high frequency 
component power is successively detected in the order of 
raster scanning for the current pixel with respect to the eight 
pixels surrounding the current pixel. In the spatial edge 
detecting circuit 903, the above detected power is compared 
with a predetermined threshold and a spatial edge detection 
flag KF is set when an edge is observed in the two- 
dimensional space. 

Furthermore, the difference detecting circuit 906 deter- 
mines the difference between the output data of the blocking 
circuit 901 and the picture data of the previous frame. Then, 
the power detecting circuit 907 detects the power of the 
above difference data. 

In the time edge detecting circuit 908, this resultant power 
is compared with the predetermined threshold value. When 
there is observed an edge along the time axis, that is, an 
abrupt change in an picture as in the case where an picture 
moves on the two-dimensional space, the time edge detec- 
tion flag JF is set 
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The spatial edge detection flag KF and the time edge 
detection flag JF arc applied to the edge judging circuit 910. 
Hie edge judging circuit 910 sets the motion-edge detection 
flag JKF when both flags KF and JF are set Thus, the motion 
edge can be detected. 

The motion edge detection flag JKF is applied to the 
motion detecting circuit 911, where the motion vector is 
detected based on the motion-edge detection flag JKF. 

That is, in the motion detecting circuit 911, the video 
signal is divided into blocks each of which consists of 8x8 
pixels, and then the motion vector is detected for the blocks 
whose corresponding motion -edge detection flag JKF is set 
in the tracking-vector detection region. 

The motion vector MV is applied to the judging circuit 
912. The judging circuit 912 detects the distribution of the 
motion vector and sets a motion vector having the largest 
count in the distribution as a tracking vector VT. 

This tracking vector VT is applied to the window- frame 
data generator 205. Then, the window-frame data generator 
205 updates the window-frame data according to the track- 
ing vector VT so that the window- frame picture WK is 
moved on the screen of the display 106 following the motion 
of the target object. 

Furthermore, by detecting the signal level of the video 
signal in the region defined by the window-frame data DW, 
it is possible to control the focus and the iris of the imaging 
device 102 following the motion of the target object. 

(3-4) Other Embodiments 

In the above embodiment, the power is detected for a 
region consisting of 3x3 pixels to detect the edge. However, 
the present invention is not limited to that The detection 
region can be set in a broad range as required. 

Furthermore, in the above embodiment, in addition to the 
picture data which is output according to the order of raster 
scanning, the picture data of eight pixels surrounding the 
above picture data is also output so that the picture data 
processing is successively carried out for each unit of data 
consisting of 3x3 pixels. However, the present invention is 
not limited to that. For example, it is also possible to divide 
the motion picture into units consisting of 3x3 pixels for the 
processing. 

In the above embodiment, the power of the difference data 
is detected by determining the sum of the absolute values of 
the difference data. However, the present invention is not 
limited to that. As in the case of the deviation data, the power 45 
of the difference data can be also obtained by calculating the 
sum of the absolute values of the deviation from the average 
value. 

Furthermore, in the above embodiment, the power of each 
data is determined from the sum of the absolute values. 
However, the present invention is not limited to that The 
high frequency component power can be also tetermined 
from the sum of squares. 

In the above embodiment, the focusing and the iris are 
adjusted based on the detection result of the tracking vector. 
However, the present invention is not limited to that A 
zooming operation or the like can be also performed in 
addition to that 

Furthermore, instead of moving the window frame, a 
similar operation can be achieved by outputting the control 
signal SC to the camera driving circuit 206 (FIG. 2) to 
change the picture sensing region following the motion of 
the target object In this case, the combination of the motion 
of the window frame and a change of the picture sensing 
region is also possible to adapt to the motion velocity. 

In the above embodiment, to detect the tracking vector, 
the contents of the table are updated directly from the 
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detected result of the motion vector. However, the present 
invention is not limited to that. A similar effect can be 
obtained by re-quantizing the motion vector. 

In this case, when the accuracy of the motion vector is not 
good enough, the size of the table can be reduced. Thus, the 
detection of the motion of the target object can be achieved 
by a simpler construction. 

Furthermore, in the above embodiment, the motion vector 
is detected only for the blocks whose corresponding motion- 
edge detection flag is set in the tracking-vector detection 
region. However, the present invention is not limited to that 
The motion vector can be also determined by selectively 
detecting the distribution after detecting the motion vector 
for all blocks. 

Alternatively, in the above processing, the motion-edge 
detection .flag may be counted for every block and the 
distribution of the motion vector may be detected only for 
the blocks having a count larger than a predetermined 
number. 

Furthermore, in the above embodiment, the target object 
is tracked by detecting the tracking vector. However, the 
present invention is not limited to that. The present invention 
can be preferably applied to various picture processing 
systems in which a motion picture is processed by detecting 
the motion edge. 

(4) An Embodiment of The Picture Conversion Apparatus 
(4-1) General Construction 

In FIG. 10, 1001 generally designates a picture conver- 
sion apparatus which performs data compression for a 
successively input video signal, and then transmits the 
compressed video signal. 

More specifically, in the picture conversion apparatus 
1001, after a video signal is converted into a digital signal, 
this digital video signal is divided into predetermined unit 
blocks BL each of which has 8x 8 pixels as shown in FIG. 
11. 

Furthermore, in the picture conversion apparatus 1001, 
these blocks BL are successively applied to a motion detec- 
tion circuit 1003, by which a motion vector V is detected for 
each block BL using the block matching method. 

That is, in the picture conversion apparatus 1001, one- 
frame-previous video data is stored in a frame memory 
1004. 

As shown in FIG. 12, the frame memory 1004 sets a 
region consisting of 40x24 pixels around the block BL 
which is input to the motion detection circuit 1003 as a 
motion vector detection area ARV. Then, the frame memory 
1004 successively outputs the video data for every block BL 
in the motion vector detection area ARV. 

The motion detection circuit 1003 detects the difference 
between the video data of the block BL and the output data 
from the frame memory 1004 so as to obtain the difference 
data between the video data of the block BL and the 
one-frame-previous video data, and then furthermore deter- 
mines the sum of the absolute values of these difference 
data. 

In the above processing, in order to obtain the motion 
vector (in this case, the motion vector consists of the values 
-X and -Y with respect to the horizontal and vertical 
directions, respectively) the motion detection circuit 1003 
successively moves the block BL within the motion vector 
detection area ARV so as to determine the position A at 
which the sum of the absolute values of the difference data 
is minimized. 

At the same time, the motion detection circuit 1003 also 
detects the sum of the absolute values of the video data for 
each block BL. Then, based on the comparison result 
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between the above sum of the absolute values and the 
detection result of the motion vector, the motion detection 
circuit 1003 outputs a selection signal SEL for selecting an 
intraframe coding processing or interframe coding process- 
ing. 5 

Thus, in the picture conversion apparatus 1001, depend- 
ing on the amount of data of each block BL, either the 
intraframe coding processing or the interframe coding pro- 
cessing is selected, and then the video signal of each block 
is transmitted. In this way, the video signal is transmitted 10 
efficiently. 

That is, in the case where the direct transmission of the 
video data of each block BL requires a less amount of the 
data in transmission, the motion detection circuit 1003 
selects the intraframe coding processing. 15 

In this case, the motion detection circuit 1003 switches the 
connection of a selection circuit 1005 so as to output the 
video signal of each block BL directly to a re-quantization 
circuit 1006. 

Furthermore, when the intraframe coding processing is 20 
selected, the motion detection circuit 1003 turns off a 
switching circuit 1007 so that the output data of the inverse 
re-quantization circuit 1008 is directly stored into the frame 
memory 1004. 

After performing the discrete cosine transform for the 25 
output data from the selection circuit 1005, the re-quanti- 
zation circuit 1006 re-quantizes the converted data, and then 
outputs the result of the re-quantization. 

A variable length coding circuit (VLC) 1010 performs 
variable length coding for the output data from the re- 30 
quantization circuit 1006, then outputs the coded result to a 
buffer circuit 1011 so as to successively output the trans- 
mission data DO at a predetermined transmission rate cor- 
responding to the capacity of the transmission line. 

In contrast, the inverse re-quantization circuit 1008 inputs 35 
the output data from the re-quantization circuit 1006, then 
performs the inverse processing to the processing performed 
by the re-quantization circuit 1006. 

Thus, when the intraframe coding processing is selected, 
the inverse re-quantization circuit 1008 reproduces the input 40 
data given to the re-quantization circuit 1006, then stores the 
reproduced data into the frame memory 1004. In this way, 
one-frame-previous video signal is stored in the frame 
memory 1004. 

On the other hand, in the case where motion compensa- 45 
tion gives less than the amount of data required for trans- 
mission, the motion detection circuit 1003 selects the inter- 
frame coding processing. 

In this case, the motion detection circuit 1003 switches the 
connection of the selection circuit 1005 so that instead of the 50 
video data of each block BL, the output data from a 
subtracter 1012 is applied to the re-quantization circuit 
1006. 

Furthermore, when the interframe coding processing is 
selected, the motion detection circuit 1003 turns on the 55 
switching circuit 1007 so that the output data of a motion 
compensation circuit 1013 is added to the output data of the 
inverse re-quantization circuit 1008, and then this resultant 
addition is stored in the frame memory 1004. 

That is, based on the detection result of the motion vector 60 
V, the motion compensation circuit 1013 cuts an area 
containing 8x8 pixels (the area with hatched lines in FIG. 
12) out of the motion vector detection area ARV, and then 
outputs the resultant video data DM of the cut area. Thus, the 
motion compensated video data is output 65 

The subtracter 1012 subtracts the motion compensated 
video data DM from the video data of each block BL, then 



outputs the motion compensated residual difference data to 
the selection circuit 1005. 

In this way, in the picture conversion apparatus 1001, after 
the discrete cosine transform is carried out for the above 
residual difference data, the re-quantization is also carried- 
out, and then the result is transmitted. 

As described above, in the picture conversion apparatus 
1001, by switching the intraframe coding processing and the 
interframe coding processing, efficient transmission of the 
video data DO is achieved using the adaptive coding method. 

Furthermore, when the interframe coding processing is 
selected, the switching circuit 1007 is turned on so that the 
motion compensated video data DM is applied to the adder 
1009. 

The adder 1009 adds the output data of the inverse 
re-quantization circuit 1008 with the motion compensated 
video data DM, thus reproduces the output data of the 
subtracter 1012 and stores the result in the frame memory 
1004. 

In this processing, depending on the amount of the data 
stored in the buffer circuit, the buffer circuit 1011 outputs a 
switching signal SP1 to the requantization circuit 1006 so as 
to switch the quantization step size of the re-quantization 
processing. 

In this way, in said picture conversion apparatus 1001, the 
video data DO is always transmitted at a constant rate. 

Furthermore, in the picture conversion apparatus 1001 of 
the present embodiment, a motion field detection circuit 
1014 decides the characteristic feature of the picture of each 
block. Then, based on this decision, the quantization step 
size is switched so that the high quality video data can be 
transmitted efficiently by making effective use of human 
visual sensitivity. 

That is, as shown in FIG. 13, the motion field detection 
circuit 1014 successively inputs the detection result of the 
motion vector, and then, for each 3x3 blocks, performs the 
processing described by the following equation: 
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Where vector V tJ represents a motion vector V in the 
block BL y corresponding to a block which is to be pro- 
cessed by the re-quantization circuit 1006. 

Subscripts K and L are given by 



L=t-Uj-l, *fl f /-l, M./fl, M,j+l 
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Thus, for each block BL, the motion field detection circuit 
1014 detects the degree of disorder Ir of the motion vector 
V between the block BL and surrounding eight blocks BL. 

That is, the vector products are obtained for the motion 
vector among the surrounding blocks BL, and then the sum 
of the absolute values of these vector products is obtained. 
If the motion vectors V show good similarity in their 
directions arid magnitudes, then a small detection result Ir is 
obtained. 

Therefore, when the calculation described by equation (1) 
is carried out for the surrounding eight blocks BL, if there 
is good similarity in the direction and the magnitude of the 
vectors V among the surrounding eight blocks BL, then the 
motion field detection circuit 1014 gives a small detection 
result Ir. 

That is, as shown in FIG. 14, in the case where the 
directions and magnitudes of the motion vectors are similar 
to each other among the surrounding blocks, it is possible to 
decide that the present block has an picture showing a 
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motion similar to the motion in surrounding blocks. As a 
result, the small detection result Ir is contained. 

On the other hand, when there is no similarity in the 
magnitude and direction of the motion vector V among the 
surrounding blocks as in FIG. 15, the present block can be 5 
considered to have an picture showing a motion different 
from those of surrounding blocks. Thus, the large detection 
result Ir is obtained. 

In this way, the motion field detection circuit 1014 detects 
the degree of disorder compared to the surrounding blocks 10 
based on the detection result Ir. Thus, the characteristic 
feature of the picture in each block compared to the sur- 
rounding blocks can be detected. 

That is, if there is a similarity in motion between a picture 
in the present block and other pictures in surrounding 15 
blocks, then it is possible to decide that the entire picture 
moves uniformly as a whole. On the other hand, if there is 
difference in motion between a picture in the present block 
and other pictures in surrounding blocks, it can be consid- 
ered that the present block moves differently compared to 20 
other surrounding blocks. 

In the case where the present block shows a different 
motion compared to the motion of other surrounding blocks, 
the present block has a characteristic feature that the deg- 
radation of the picture quality in the present block cannot be 25 
easily perceived. 

Therefore, for the present area, the quantization step size 
is set to a large value, and then, as a result of this, a small 
quantization step size can be given for other areas. Thus, the 
degradation of the picture quality can be effectively avoided 30 
and efficient transmission of the video signal can be 
achieved. 

Furthermore, in the process of detecting the degree of 
disorder Ir, the motion field detection circuit 1014 makes 
weighing in such a way that the vector products are weighed 35 
by the factor of 2" 1/2 for the adjacent blocks existing apart 
in oblique directions to the right and the left. Thus, the 
detection of the degree of disorder is carried out taking into 
account the effect of the distance between the control block 
BL V and other blocks. 40 

In this way, the degree of the disorder Ir is detected taking 
into account the distance from the central block BL^, the 
detection of the disorder can become more realistic corre- 
sponding to the actual motion of the picture. 

Therefore, if the quantization step size is switched based 45 
on the detection result of disorder, then higher efficiency can 
be achieved in transmission of a higher quality video signal 
by making more effective use of human visual sensitivity. 

That is, the motion field detection circuit 1014 outputs the 
switching signal SP2 to the re-quantization circuit 1006 50 
based on the detection result of the disorder Ir. 

As shown in FIG. 16, by switching the table Tl to TN, the 
re-quantization circuit 1006 switches the quantization step 
size from Q, to Q„ according to the switching signal SP1 and 
SP2 so that the quantization step size Qi~Q„ can be switched 55 
depending on the nature of a picture and on the amount of 
the data stored in the buffer memory 1011. 

As shown in FIG. 17, a demodulation circuit 1701 gives 
the transmission data DO to a decoding circuit 1703 via the 
buffer memory 1702. The decoding circuit 1703 performs 60 
the inverse processing to the processing performed by the 
variable length coding circuit 1010 so as to reproduce the 
output data of the re-quantization circuit 1006. 

An inverse re-quantization circuit 1704 performs the 
inverse processing to the processing performed by the 65 
re-quantization circuit 1006 according to the switching 
signal SP1 and SP2 transmitted together with the transmis- 
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sion data DO. Thus, the input data of the re-quantization 
circuit 1006 is reproduced. 

A selection circuit 1705 switches the connection accord- 
ing to the selection signal SEL so mat when the intraframe 
coding processing is selected, the output data of the inverse 
re-quantization circuit 1704 is directly output. 

Thus, the demodulation circuit 1701 can reproduce the 
mtraframe-coded video data D01. 

A frame memory 1706 stores the output data of the 
selection circuit 1705, Thus, one-frame-previous video data 
is stored as in the picture conversion apparatus 1001. 

On the other hand, when the interframe coding processing 
is selected, the selection circuit 1705 switches the connec- 
tion so that the output data of an adder 1707 is selectively 
output. 

The adder 1707 inputs the output data of the frame 
memory 1706 via a motion compensation circuit 1708, then 
adds the motion compensation video data with the video 
data coming from the transmission object Then, the added 
result is output. 

Thus, when the interframe coding processing is selected, 
the adder 1707 reproduces the input data of the adder 1012 
so that the demodulation circuit 1701 reproduces the video 
signal transmitted via the selection circuit 1705. 

(4-2) Operation of the Embodiment 

In the above construction, the video signal is converted in 
a digital signal, and then applied to a motion detection 
circuit 1003 by a unit data of a block BL containing 8x8 
pixels. Then, the motion detection circuit 1003 detects 
motion vector V using the block matching method. 

This motion vector is applied to a motion compensation 
circuit 1013, by which the motion compensation is carried 
out for the one-frame-previous video data. 

The motion compensated video data is applied to a 
subtracter 1012, by which the motion compensated video 
data is subtracted from the successively input video data to 
produce the residual difference data. 

When the interframe coding processing is selected, a 
re-quantization circuit 1006 performs discrete cosine trans- 
form for the residual difference data, then re-quantizes the 
resultant converted data. The resultant quantized data is 
output. 

On the other hand, when the intraframe coding processing 
is selected, the re-quantization circuit 1006 performs dis- 
crete cosine transform directly for the successively input 
video data instead of the residual difference data, and then 
re-quantizes and outputs it. 

In the above processing, a motion field detection circuit 
1014 detects the degree of disorder of the motion vector V 
so that the quantization step size is switched according to the 
above detection result SP2. 

When there is no similarity in the direction and the 
magnitude between the motion vector V in the present block 
and those in the surrounding blocks, the quantization step 
size is set large. As a result of this, it becomes possible that 
the step size is set large. As a result of this, it becomes 
possible to set the quantization step size small for other 
areas. 

In this way, the quantization step size is set large for the 
area where the degradation of the picture quality cannot be 
easily perceived. Thus, as a result of this, it becomes 
possible to set the quantization step size small for other 
areas. Hence, highly efficient transmission of high quality 
video signals can be achieved by making effective use of 
human visual sensitivity. 

(4-3) Other Embodiments 

In the above embodiment, the degree of disorder of the 
motion vector is detected within the area of 3x3 blocks. 
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However, the present invention is not limited to that The 
area where the detection is carried out can be set to any size 
as required. 

Furthermore, in the above embodiment, an area of 40x24 
pixels is set as a motion vector detection area for a block of 5 
8x8 pixels. However, the present invention is not limited to 
that. The size of the block and the size of the motion vector 
detection area can be freely set as required. 

Furthermore, in the above embodiment, the interframe 
coding processing and intraframe coding processing is 
switched for one unit block. However, the present invention 
is not limited to that. For example, the interframe coding 
processing and the intraframe coding processing can be 
switched for one frame. Moreover, other similar modifica- 
tions are also possible. 

While there have been described several preferred 15 
embodiments of the present invention, it will be obvious to 
those skilled in the art that various changes and modifica- 
tions can be made that fall within the true spirit and scope 
of the invention. 
What is claimed is: 20 
1. A target object following apparatus comprising: 
imaging means having a focus and an iris, for picking up 
an image of an imaging area and supplying a video 
signal corresponding to data produced therefrom as 
picture data including a target object; 
imaging area changing means for changing said imaging 
area of said imaging means on a basis of a predeter- 
mined control signal; 
a picture data blocking circuit for dividing said picture 30 
data corresponding to said image of said imaging area 
which is sequentially input into blocks of a predeter- 
mined number of pixels in both a horizontal direction 
and a vertical direction, said picture data being supplied 
from said image means; 35 
an input circuit for setting a position of an area containing 
said target object in said picture data according to an 
input by a user and supplying a position signal pro- 
duced therefrom; 
a detection area setting circuit for setting a tracking vector 40 
detection area including a predetermined number of 
said blocks in the horizontal and the vertical directions 
according to said position signal; 
a motion detection circuit for detecting motion vectors for 
respective ones of said blocks in said tracking vector 
detection area and supplying the detected motion vec- 
tors produced therefrom; 
a tracking vector detection circuit for detecting a distri- 
bution of said detected motion vectors of said respec- 5Q 
tive ones of said blocks in said tracking vector detec- 
tion area and then detecting a tracking vector with a 
moving direction and a moving quantity of a portion of 
a picture in said tracking vector detection area on a 
basis of said distribution detection result; 55 
a detection area correction circuit for moving said track- 
ing vector detection area in correlation with a motion of 
said target object in said picture data, said tracking 
vector detection area being moved on a basis of said 
tracking vector with said moving direction and said 60 
moving quantity detected by said tracking vector detec- 
tion circuit; 

a window-frame data generation circuit for generating 
window-frame picture data of a window frame corre- 
sponding to said tracking vector detection area, and for 65 
supplying said predetermined control signal to said 
imaging area changing means; 



45 



a picture composing circuit for superimposing said win- 
dow frame represented by said window-frame picture 
data upon said video signal, and generating a composite 
video signal therefrom; 

display means for receiving said composite signal, and 
displaying a picture with said window frame superim- 
posed; and 

control means for detecting a signal level of said video 
signal for said tracking vector detection area, and for 
supplying a second predetermined control signal to said 
imaging means and thereby controlling said focus and 
said iris of said image means on a basis of said detected 
signal level of said video signal. 

2. The target object following apparatus according to 
claim 1, wherein said motion detection circuit includes 
means for computing said plurality of motion vectors by 
performing a block matching method. 

3. The target object following apparatus according to 
claim 1 or 2 further comprising: 

a second motion detection circuit for detecting a plurality 
of motion vectors of respective ones of a plurality of 
blocks forming said picture data; 

a picture data processing circuit for motion compensating 
said plurality of blocks forming picture data on the 
basis of said plurality of motion vectors and outputting 
residual data produced herefrom; 

a motion field detection circuit for detecting a disorder of 
each one of said plurality of motion vectors for a 
respective one of said plurality of blocks relative to 
motion vectors of respective surrounding blocks adja- 
cent to said respective one of said plurality of blocks 
and producing an indication of said detected disorder, 

a quantizing circuit receiving said indication of said 
detected disorder and for quantizing said residual data 
and outputting quantized data produced therefrom; and 

a buffer circuit for storing said quantized data and out- 
putting said stored quantized data as transmission data, 

wherein said quantizing circuit changes a quantizing step 
size greatly when said indication of said detected 
disorder of said one of said plurality of motion vectors 
for said respective one of said plurality of blocks is 
high. 

4. A target object following apparatus comprising: 

a spatial edge detection circuit for outputting a spatial 
edge detection result for a motion picture comprising a 
plurality of sequentially input frames; 

a time edge detection circuit for outputting a time edge 
detection result for said motion picture; and 

an edge judging means for outputting a motion edge 
detection result, on a basis of said spatial edge detection 
result and said time edge detection result; 

wherein said spatial edge detection circuit comprises a 
spatial power detection circuit for outputting a spatial 
power detection result detecting powers of high fre- 
quency components for a plurality of predetermined 
blocks of said frames; and 

a first comparison circuit for obtaining a first comparison 
result comparing said spatial power detection result 
with a first comparison reference, and for outputting 
said spatial edge detection result when said spatial 
power detection result is larger than said first compari- 
son reference; and 

wherein said time edge detection circuit comprises a time 
power detection circuit for obtaining a difference data 
between a present frame and a previous frame of said 
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motion picture, and for detecting a power of said 
difference data to output a time power detection result 
for each of said predetermined blocks; and 

a second comparison circuit for obtaining a second com- 
parison result comparing said time power detection 5 
result with a second comparison reference, and then, 
when said time power detection result is larger than 
said second comparison reference, for outputting said 
time edge detection result; 

wherein said edge judging means judges an edge as 10 
having a motion when both of said spatial edge detec- 
tion result and said time edge detection result are 
obtained, and then for outputting said motion edge 
detection result. 

5. The target object following apparatus according to 15 
claim 4, further comprising: 

a picture data blocking circuit for dividing said sequen- 
tially input frames into said plurality of predetermined 
blocks and another plurality of predetermined blocks of 
a predetermined number of pixels in a horizontal direc- ^ 
tion and a vertical direction; 

a detection area setting circuit for setting a tracking vector 
detection area including a predetermined number of 
said another plurality of predetermined blocks in the 
horizontal and the vertical directions; 

a motion detection circuit for detecting a motion vector 
for respective ones of said predetermined number of 
said another plurality of predetermined blocks within 
said tracking vector detection area; and 

a tracking vector detection circuit for detecting a distri- 30 
bution of said motion vectors within said tracking 
vector detection area on the basis of the detection 
results of said spatial edge detection circuit in said 
target object following apparatus, and then detecting a 
moving direction and a moving quantity of said picture 35 
within said tracking vector detection area on the basis 
of said distribution detection result. 

6. The target object following apparatus according to 
claim 5, further comprising: 

an imaging means for imaging the target object, and for 40 
outputting said plurality of sequentially input frames 
into said target object following apparatus; 

an imaging area changing means for changing an imaging 
area of said imaging means on the basis of a predeter- 
mined control signal; and 45 

a detection area correction circuit for tracking the move- 
ment of said picture within said tracking vector detec- 
tion area on the basis of the detection result of said 
tracking vector detection circuit within said target 
object following apparatus. 50 

7. The target object following apparatus according to 
claim 5 or 6, wherein said motion detection circuit includes 
means for computing said plurality of motion vectors by 
performing a block matching method. 

8. The target object following apparatus according to 55 
claim 4, 5 or 6 further comprising: 

a second motion detection circuit for detecting a plurality 
of motion vectors of respective ones of a plurality of 
blocks forming one of said sequentially input frames; ^ 

a picture data processing circuit for motion compensating 
said plurality of blocks forming said one of said 
sequentially input frames on the basis of said respective 
plurality of motion vectors and outputting residual data 
produced therefrom; 65 

a motion field detection circuit for detecting a disorder of 
each one of said plurality of motion vectors for a 
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respective one of said plurality of blocks relative to 
motion vectors of respective surrounding blocks adja- 
cent to said respective one of said plurality of blocks 
and providing an indication of said detected disorder; 

a quantizing circuit responsive to said indication of said 
detected disorder and for quantizing said residual data 
and outputting quantized data produced therefrom; and 

a buffer circuit for storing said quantized data and out- 
putting said stored quantized data as transmission data, 

wherein said quantizing circuit changes a quantizing step 
size greatly when said indication of said detected 
disorder of said one of said plurality of motion vectors 
for said respective one of said plurality of blocks is 
high. 

9. The target object following apparatus according to 
claim 1 or 4, wherein said tracking vector detection circuit 
stores into tables said detected motion vectors of said 
respective ones of said blocks in said tracking vector detec- 
tion area, said detected motion vectors having respective 
moving directions and moving quantities, 
and determines said tracking vector with said moving 
direction and said moving quantity using a vector 
having a largest count in said distribution of said 
detected motion vectors of said respective ones of said 
blocks in said tracking vector detection area stored in 
said tables. 

ID. A picture conversion apparatus comprising: 
a motion detection circuit for detecting a plurality of 
motion vectors for a plurality of respective blocks 
forming picture data, for calculating a sum of absolute 
values for each block of picture data, and for generating 
a selection signal for the block of picture data accord- 
ing to a comparison of said corresponding sum of 
absolute values and corresponding motion vector of the 
block of picture data; 
a picture data processing circuit for motion compensating 
said plurality of blocks forming picture data on the 
basis of said plurality of motion vectors and outputting 
residual data produced therefrom for each motion vec- 
tor, 

a selection circuit for switching between each block of 
picture data and said corresponding residual data for 
the block according to said selection signal and sup- 
plying a pre-quantized video signal therefrom; 
a motion field detection circuit for detecting a disorder of 
each one of said plurality of motion vectors relative to 
motion vectors of respective surrounding blocks adja- 
cent to a block corresponding to the motion vector for 
which said disorder is detected, and producing an 
indication of said detected disorder; 
a quantizing circuit receiving said indication of said 
detected disorder and for quantizing said pre-quantized 
video signal and outputting quantized data produced 
therefrom, said quantizing circuit changing a quantiz- 
ing step size according to said indication of said 
detected disorder of the motion vector; and 
a buffer circuit for storing said quantized data and out- 
putting said stored quantized data as transmission data. 
11. The picture conversion apparatus according to claim 
10, wherein said motion field detection circuit calculates 
said disorder of the motion vector by executing an outer- 
product of the motion vector and each one of said motion 
vectors of said respective adjacent surrounding blocks, and 
then executing an absolute summation of outer-product 
results corresponding to said respective adjacent surround- 
ing blocks, 
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wherein the motion vector has a magnitude of A and the a sine of an angle between the motion vector and said 

one of said motion vectors of said respective adjacent one of s ^ d motion vectors of said respective adjacent 

surrounding blocks has a magnitude of B, and surrounding blocks. 

the magnitude of the outer product equals A times B times ***** 
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